Web Survey Bibliography
Traditionally, business data for official statistics have been collected with paper questionnaires in self administrative surveys. Nowadays the paper questionnaire is more and more replaced by web questionnaires. A variety of strategies can be followed to introduce the web in business surveys. In Norway in 2004, and recently in Denmark, it has been decided that all business surveys should be transformed to the web quickly. In the Netherlands an effort has been made to develop a well-designed web questionnaire: the Structural Business Survey questionnaire was fully designed and pre-tested in a two-year period. The result was supposed to serve as an example for all other surveys. A driving force behind this development is a common interest by the surveyors and those who are surveyed to reduce the manpower, and hence the costs of business surveys (including response burden).
But neither these ambitions nor quality improvements come automatically with technological innovations. At international conferences, workshops and meetings, we find that many methodologists are struggling with the implementation of these technologies. In February 2010, methodologist from 8 European countries met in Copenhagen to discuss how common EU-regulated surveys best can be transferred from paper to web (both for business and social surveys; the focus was on business surveys). The idea for this meeting was born when data collection methodologists from Statistics Denmark visited Statistics Netherlands in May 2009 to discuss web questionnaire designs. The initiative to organise this meeting was taken at the 2009 ISM Workshop in Bergamo. In follow-up to the Copenhagen meeting, this topic was also at the agenda of the Eurostat Working Group of Statistical Quality in June 2010. Here it was decided to discuss the need for an action plan and concrete projects with the Directors of Methodology.
This 2011 ISM presentation is a follow-up of the Copenhagen initiative, and is meant to report back to the participants what has been done. In the presentation we will give an overview of the issues that have been discussed, and relate those to non-sampling errors like non-response and measurement issues, as well as response burden. We would like to discuss with the audience how the Copenhagen initiative and the issues raised best could be followed up.
Issues that have been discussed (and which have relations to other presentations in the Workshop) are:
– An issue that is discussed over and over again is how to get sampled units pick-up the web questionnaire: What strategies should be used to increase the take-up rate? Should a paper questionnaire still be available, and presented?
– Where are we when it comes to guidelines in how to design web questionnaires? One much discussed issue under this headline is how similar or different web and paper questionnaires in a mixed mode data collection design should be. When respondents use a web questionnaire, they expect it to have some intelligence. What do respondents expect and what guidelines can be given to make the questionnaire respondent friendly? Issues here are e.g. the use of matrix questions and edit checks that help to get good data quality but may also result in aborting the completion of the questionnaire. Another issue is the use of historic data in the questionnaire (comparable to dependent interviewing).
– Talking about mixed-mode designs: How to deal with mode effects?
– Technology issues include e.g. how to deal with the variety of software browsers?
– How to implement web questionnaires? When moving to the web, Statistics Netherlands on the one side, and Statistics Norway and Statistics Denmark on the other, adopted different approaches (as discussed above). What did we learn from these two approaches?
– Once a questionnaire has been developed, the issue is: How do new methods affect pre-tests and the ability to monitor the response process?
During the development of web questionnaires traditional cognitive interviewing and the techniques of usability studies can be combined, e.g. by using paradata and eye-tracking during individual tests. Computerized questionnaires also opens the possibility to monitor the response process in a detailed way while conducting the survey (using paradata), both at the level of overall response rates as well at the level of individual respondents (using audit trails).
In our presentation we will focus in some more detail on web pick-up issues and response burden issues.
Issues that have not yet been addressed, but which are important and can be discussed at the workshop, are:
– How to organising the data collection and logistics for web and mixed-mode surveys?
– What software should be used: develop ones own software or use software that is available in the market?
– How to organise research, collaborate with universities, and bring in the literature?
Workshop Homepage (abstract) / (presentation)
Web survey bibliography - Other (439)
- What can be said about quality in the Central Population Register based on a self-completion survey...; 2012; Falnes-Dalheim, E., Pedersen, H. E.
- Boosting Web pick-up Rates by referring to Compliance Principles ; 2012; Falnes-Dalheim, E., Haraldsen, G., Sundvoll, A.
- Subjective Well-being Of Spanish Workers: Continuous Voluntary Web Survey Examination; 2012; de Pedraza, P., Guzi, M.
- Facing The Future Webcams as a survey tool in China; 2012; Gordon, A., Llewellyn, T., Gu, E.
- Reality check in the digital age: The relationship between what we ask and what people actually do; 2012; Hofmeyr, J., Louw, A.
- WEBDATANET: web-based data-collection methodological challenges, solutions and implementations. Action...; 2012; de Pedraza, P.
- WebSM Study: Survey software features overview ; 2012; Vehovar, V., Cehovin, G., Kavcic, L., Lenar, J.
- Use of Web 2.0 to Recruit Australian Gay Men to an Online HIV/AIDS Survey; 2012; Theriault, N., Bi, P., Hiller, J. E., Nor, M.
- Evaluation of an online (opt-in) panel for public participation geographic information systems surveys...; 2012; Brown, G., Weber, D., Zanon, D., de Bie, K.
- Measures of Data Quality Across the RDD Frames; 2012; Lavrakas, P. J.
- Collecting data electronically from enterprises – searching for the right approach; 2012; Keating, J., Portillo, S.
- Psychometric properties of an internet administered version of the Marlowe-Crowne Social Desirability...; 2012; Vesteinsdottir, V., Reips, U.-D., Joinson, A. N., Porsdottir, F.
- Analysis of coverage bias for the implementation of web surveys in Spain; 2012; de Pedraza, P., Serrano, F.
- Presidential Elections in Iceland 2012 – Did online panel surveys give false hope to new candidates...; 2012; Jonsdottir, G. A., Dofradottir, A. G., Bjornsdottir, A. E.
- Website exit surveys. What can we measure with them?; 2012; Andreadis, I.
- Analyzing Functionalities for Online Questionnaire System (OQS); 2012; Atown, H. Y.
- Bringing data from an online survey or spreadsheet into SPSS; 2012; Raftery, D.
- Exploring the impact of animation-based questionnaire on conducting a web-based educational survey and...; 2012; Chien, Y.-T., Chang, C.-Y.
- The “frequency divide”: implications for internet-based surveys; 2012; Vicente, P., Reis, E.
- Open-ended Questions in Web Surveys: One Large vs. Ten Small Boxes; 2012; Keusch, F.
- The influence of social desirability on data quality in face-to-face and web surveys; 2012; Keusch, F.
- User models as revealed in web-based research services; 2012; Bodoff, D., Raban, D.
- Who should supervise students during self-report interviews? A controlled experiment on response behavior...; 2012; Walser, S., Killias, M.
- Using Webinar Polls to Collect Online Survey Data: The Case of a Behavioral Finance Problem; 2012; Sahu, C.
- Online Questionnaires for Outbreak Investigations; 2011; Parry, A. E.; Johnson, D. R.; Byron-Gray, K.; Raupach, J. C. A.; McPherson, M.
- Inventory of published research: Response burden measurement and reduction in official business statistics...; 2011; Giesen, D. & Snijkers, G. (Eds.), Bavdaz, M., Bergstrom, Y., Gravem, D. F., Haraldsen, G., Hedlin, D...
- Understanding the new digital divide—A typology of Internet users in Europe; 2011; Brandtzæg, P.B.; Heim, J.; Karahasanoviæ, A.
- Patients’ attitudes toward side effects of antidepressants: an Internet survey; 2011; Kikuchi, T., Uchida, H., Suzuki, T., Watanabe, K., Kashima, H.
- Web-based or paper-based surveys: a quandary?; 2011; Bennett, L., Sid Nair, C.
- Less questions, more data: Revitalizing the european currency in single source affluent audience measurement...; 2011; Hartman, H.
- Methodological challenges in the use of the Internet for scientific research: Ten solutions and recommendations...; 2011; Reips, U.-D., Buchanan, T., Krantz, J. H., McGrawn, K.Reips, U.-D.
- Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes; 2011; Lindhjem, H., Navrud, S.
- The impact of cookie deletion on site-server and ad-server metrics in Australia. An empirical comScore...; 2011
- Mobile, webmail, desktops: Where are we viewing email now?; 2011
- Evaluating the usability of personal digital assistants to collect behavioral data on adolescents with...; 2011; McClamroch, K. J.
- Eurobarometer Special surveys: EB75.1 E-Communications Household Survey. Special Eurobarometer 362; 2011
- Classic Inspirations for Social Research Methodology in the time of Online Access Panels ; 2011; Jerabek, H.
- Background - QSOAP; 2011
- Facial imaging: The new face of online survey research; 2011; Gordon, A., McCallum, D., Sorci, M., Llewellyn, T.
- The optimal number of response options in internet panel surveys; 2011; Thorsdottir, F.
- Romanian financing opportunities for the action; 2011; Moga, L.
- Collecting information with Knowledge technologies; 2011; Foulonneau, M.
- Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences; 2011; Snijkers, G., Haraldsen, G., Stax, H.-P.
- Experiences with mixed mode mail & web-enquêtes in probability samples with known individuals; 2011; Kalgraff Skjak, K., Kolsrud, K.
- The use of paradata to improve data collection at Statistics Canada: Empirical results and research; 2011; Gambino, J., Wrighte, D.
- A new online building survey system; 2011; Wang, Yic.
- A Comparison of Internet-Based Participant Recruitment Methods: Engaging the Hidden Population of Cannabis...; 2011; Temple, E. C., Brown, R. F.
- Experiences with the online questionnaire on www.csfd.cz as a part of mixed research; 2011; Kratka, J.
- Administered versus self-administered online surveys: Are the findings comparable?; 2011; de Rada, V. D.
- Methodological Issues in Internet-Mediated Research: A Randomized Comparison of Internet Versus Mailed...; 2011; Whitehead, L.